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ABSTRACT  ( Continue  on  reveree  aide  II  neceaaery  and  identify  by  block  number) 

This  report  reviews  the  characteristics  of  a class  of  adaptive  filters  useful  in  signal  processing 
and  other  applications  where  the  properties  of  the  signal  are  unknown  or  variable  with  time. 
The  basic  element  of  these  filters  is  the  adaptive  linear  combiner,  which  weights  (adjusts  the 
gain  of)  and  sums  a set  of  input  signals  to  form  a single  output  signal.  The  weighting  process 
is  governed  by  a recursive  algorithm  that  seeks  to  minimize  the  mean  square  of  the  difference 
between  the  combiner's  output  and  a “desired  response”  (training  signal).  It  is  shown  that 
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20.  Continued 

for  statistically  stationary  inputs  the  mean-square  difference  is  a quadratic  function  of  the 
weight  values,  allowing  the  minimum  to  be  sought  by  gradient  estimation  and  other  similar 
techniques.  Expressions  are  given  that  define  the  relationship  between  rate  of  adaptation 
and  deviation  from  optimal  performance  due  to  noise  in  the  gradient  estimation  process 
for  the  Widrow-Hoff  LMS  algorithm.  Methods  of  deriving  the  inputs  to  the  combiner  are 
described,  including  the  use  of  a tapped  delay  line  to  form  an  adaptive  transversal  filter. 
Experimental  results  obtained  by  computer  simulation  are  presented  that  show  the  ability 
of  the  adaptive  transversal  filter  to  model  an  unknown  network  or  physical  system;  to 
reduce  or  eliminate  intersymbol  interference  in  multipath  communication  channels;  to 
reduce  or  eliminate  periodic  interference  in  electrocardiography  and  broadband  interference 
in  the  sidelobcs  of  an  antenna  array;  and  to  separate  periodic  and  broadband  signals  and 
detect  very  low  level  periodic  signals. 
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SUMMARY 


This  report  reviews  the  characteristics  of  a class  of  adaptive  filters  useful  in  signal 
processing  and  other  applications  where  the  properties  of  the  signal  are  unknown  or  variable 
with  time.  The  basic  element  of  these  filters  is  the  adaptive  linear  combiner,  which  weights 
(adjusts  the  gain  of)  and  sums  a set  of  input  signals  to  form  a single  output  signal.  The 
weighting  process  is  governed  by  a recursive  algorithm  that  seeks  to  minimize  the  mean 
square  of  the  difference  between  the  combiner’s  output  and  a “desired  response”  (training 
signal).  It  is  shown  that  for  statistically  stationary  inputs  the  mean-square  difference  is  a 
quadratic  function  of  the  weight  values,  allowing  the  minimum  to  be  sought  by  gradient 
estimation  and  other  similar  techniques.  Expressions  are  given  that  define  the  relationship 
between  rate  of  adaptation  and  deviation  from  optimal  performance  due  to  noise  in  the 
gradient  estimation  process  for  the  Widrow-Hoff  LMS  algorithm.  Methods  of  deriving  the 
inputs  to  the  combiner  are  described,  including  the  use  of  a tapped  delay  line  to  form  an 
adaptive  transversal  filter.  Experimental  results  obtained  by  computer  simulation  are  pre- 
sented that  show  the  ability  of  the  adaptive  transversal  filter  to  model  an  unknown  network 
or  physical  system;  to  reduce  or  eliminate  intersymbol  interference  in  multipath  communica- 
tion channels;  to  reduce  or  eliminate  periodic  interference  in  electrocardiography  and  broad- 
band interference  in  the  sidelobes  of  an  antenna  array  ; and  to  separate  periodic  and  broad- 
band signals  and  detect  very  low  level  periodic  signals. 
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INTRODUCTION 


The  term  "filter"  may  be  applied  to  any  device  or  system  that  processes  incoming 
signals  or  other  data  in  such  a way  as  to  smooth  or  classify  them,  predict  future  values,  or 
eliminate  interference.  Adaptive  tillers  are  devices  that  automatically  adjust  their  own 
parameters  and  seek  to  optimize  their  performance  according  to  a specific  criterion.  Though 
somewhat  more  difficult  to  design,  analyze,  and  build  than  fixed  filters,  they  offer  the 
potential  of  substantial  improvements  in  performance  when  signal  properties  are  unknown 
or  variable  with  time. 

This  report  is  concerned  with  a particular  class  of  adaptive  filters  and  with  their 
application  to  problems  primarily  in  the  field  of  signal  processing.  These  filters  have  as  their 
basic  element  a device  that  is  versatile  and  relatively  easy  to  implement  in  hardware  or  soft- 
ware. This  device,  the  adaptive  linear  combiner,  is  treated  first  in  the  following  pages.  The 
Widrow-Hoff  LMS  algorithm,  the  most  efficient  of  a number  of  algorithms  available  for 
governing  its  operation,  is  considered  next.  Methods  of  deriving  input  signals  for  the  com- 
biner to  form  adaptive  filters  are  then  considered,  with  emphasis  on  the  use  of  a tapped 
delay  line  to  form  an  adaptive  transversal  filter.  The  applications  subsequently  presented 
show  how  the  adaptive  transversal  filter  can  be  used  to  perform  modeling  and  equalization 
tasks,  cancel  interference,  and  detect  low-level  signals. 

THE  ADAPTIVE  LINEAR  COMBINER 

The  adaptive  linear  combiner,  illustrated  in  figure  1 , is  the  basic  element  of  the 
adaptive  filters  considered  in  this  report. ' A set  of  n measurements  Xjttl  is  sampled  to  form 

n sampled  measurements  Xjj.  where  j is  the  time  index.  Each  measurement  is  multiplied  by 
a corresponding  weighting  coefficient  Wj.  and  the  weighted  measurements  are  summed  to 
form  an  output  yj.  I bis  output  is  compared  with  a desired  response  dj  to  form  an  error 
signal  6j . The  objective  is  to  choose  the  weighting  coefficients  in  such  a way  as  to  minimize 

the  error  signal  and  find  the  weighted  sum  of  input  signals  that  best  matches  the  desired 
response. - 


1 The  combiner  is  linear  only  when  the  weigh  ling  coefficients  defined  below  are  fixed  Adaptive  systems,  like  all  systems 
, whose  characteristics  change  with  die  characteristics  of  their  input  signals,  are  by  nature  nonlinear. 

- The  earliest  adaptive  systems  (ref.  I.  Ji  anil  many  current  systems,  particularly  adaptive  antenna  arrays  (ref.  J).  employ 
as  weights  balanced  modulators  driven  by  an  integrator  or  a narrow  low  or  band  pass  filter  These  systems,  although 
apparently  different  from  S'  stems  based  on  the  adaptive  linear  combiner,  have  similar  characteristics  and  can  be 
considered  as  an  alternative  and  sometimes  preferable  implementation 


Tilt*  jth  output  signal  ot  the  combiner  is  given  by 
n^ 

yj  = l wiv 

i=l 

whu.li  may  be  written  in  matrix  form  as 


Vj  = x}w  = wTXj, 


(2) 


where  J(j  and  W are  vectors  of  the  measurements  and  weights  respectively.  The  error  signal 
is  given  by 


eJ  = dj 


y-dj 


WTXj. 


The  square  of  the  error  is 


(3) 


ei  ’ d j - 3djxI ~ * S-  H 

The  mean  square  error,  obtained  by  taking  the  expected  value  of  equation  (4),  is 

E['i]  * E [dj]  - ’E  [djXl] « + K1*  [SjXTJw  (5 

Defining  the  vector  P as  the  cross  correlation  between  the  desired  response  (a  scalar)  and  X 
then  yields  « 

^EN“E[diX«diX2i dixnJT  16 
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The  input  correlation  matrix  R is  defined  as 

I"*  I ix  lj  x I j x 2 j 


x2jx  lj  x 2j x 2 j 


• xnjxn.l  I 


The  mean  square  error  can  thus  be  expressed  as 

E Jejl  = E [d^]  - 2PTW  + WTgW. 


(7) 


<H) 


Note  that  for  stationary  inputs  the  error  is  a quadratic  function  of  the  weights  that  can  be 
pictured  as  a concave  hyperparaboloidal  surface,  a function  with  a unique  minimum. 
Adjusting  the  weights  to  minimize  the  error  is  accomplished  by  descending  along  this  surface 
with  the  objective  of  finding  its  minimum.  Gradient  methods  are  commonly  used  for  this 
purpose. 


The  gradient  V of  the  error  function  is  obtained  by  differentiating  equation  (8)  with 
respect  to  the  weight  vector  W: 

= -2P  + 2RW.  (9) 

The  optimal  weight  vector  W*.  generally  called  the  Wiener  weight  vector,  is  obtained  by 
setting  the  gradient  of  the  mean  square  error  function  to  zero: 


V A 


dE  ej]  3F.  e~ 
■***  » • • • » ■>« 

3w,  dw„ 


W*  = R-1  P. 


GO) 


This  equation  is  a matrix  form  of  the  Wiener-Hopf  equation  (ref.  4,  5).  The  minimum  mean 
square  error  (mse)  can  be  expressed  as  follows  by  substituting  equation  ( 10)  into  equation 
(8): 


minimum  mse  = 


P. 


(11) 


THE  LMS  ALGORITHM 


The  practical  objective  of  adaptive  processes  using  the  adaptive  linear  combiner  is  to 
find  a solution  to  equation  (10).  An  exact  solution  would  require  a priori  knowledge  of  the 
correlation  matrixes  P and  R.  Since  this  knowledge  is  not  available,  one  must  find  an 
approximate  solution.  One  way  of  doing  so  would  be  directly  by  numerical  means.  This 
approach,  however,  would  present  serious  computational  difficulties  when  the  number  of 
weights  was  large  or  the  input  data  rate  high.  In  addition  to  the  inversion  of  an  n X n 
matrix,  it  would  require  as  many  as  n(n+l  )/2  autocorrelation  and  cross  correlation  measure- 
ments to  obtain  the  elements  of  P and  g.  Further,  this  procedure  would  have  to  be 
repeated  in  most  circumstances,  where  the  input  signal  statistics  would  be  slowly  varying. 


f or  those  reasons  it  is  more  practicable  to  use  other  recursive  statistical  estimation  methods 
in  algorithms  intended  tor  use  with  the  adaptive  linear  combiner. 


A simple  iterative  procedure  tor  finding  an  approximation  to  the  optimal  weight 
vector  of  the  adaptive  linear  combiner  is  the  LMS  ("least  mean  square”)  algorithm  devised 
by  B.  Widrow  and  M.  E.  Hoff,  Jr.  (ref.  6.  7.  8.  c>).  This  algorithm  does  not  require  explicit 
measurements  ot  correlation  (unctions,  nor  does  it  involve  matrix  inversion.  Accuracy  is 
limited  by  statistical  sample  size,  however,  since  the  weight  values  are  based  on  real-time 
measurements  of  the  input  signals. 

The  LMS  algorithm  is  based  on  the  method  of  steepest  descent.  According  to  this 
method  the  "next"  weight  vector  Wj+|  is  equal  to  the  “present"  weight  vector  Wj  plus  a 

change  proportional  to  the  negative  of  the  instantaneous  gradient  Vj: 

Wj+,  = Wj  (12) 

where  p is  a parameter  that  controls  stability  and  rate  of  convergence.  An  estimate  of  the 
instantaneous  gradient  Vj  is  obtained  in  a crude  but  efficient  manner  by  assuming  that  the 

square  ot  a single  error  sample  e.  is  an  estimate  ot  the  mean  square  error  and  by  differentiat- 
ing it  with  respect  to  W: 


if? 

1 

T 

= 2 e 

*L 

dwi 

dw„ 

“eJ 

3w  ■ 

r)w 

L 1 "J 

W=Wj 

L 1 nJ 

Since  the  estimated  gradient  components  are  related  to  the  partial  derivatives  of  the 
instantaneous  error  with  respect  to  the  weight  components,  which  can  be  obtained  by 
differentiating  equation  (4).  this  expression  simplifies  to 


(13) 


V-2ejXj.  ( ,4, 

Equation  (12)  thus  becomes 

Wj+,  =Wj  + 2^jXj.  (15) 

Ibis  algorithm  is  easily  implemented  in  real-time  systems.  It  requires  only  two  multiplica- 
tions and  two  additions  per  component  of  X per  input  sample. 


It  has  been  shown  that  the  gradient  estimate  used  in  the  LMS  algorithm  is  unbiased 
and  that  the  expected  value  of  the  weight  vector  converges  to  the  Wiener  weight  vector  when 
the  input  vectors  are  uncorrelated  over  time  (ref.  8.  9,  10,  1 1 ).-*  Starting  with  an  arbitrary 
initial  weight  vector  the  algorithm  will  converge  in  the  mean  and  will  remain  stable  as  long 
as  the  parameter  p is  greater  than  zero  but  less  than  the  reciprocal  of  the  largest  eigenvalue 
Xmax  B 

1/Xmax>^>0-  (lb) 


Adaptation  with  correlated  input  rectors  has  been  analyzed  in  references  13  and  IJ  Extremely  high  correlation  and 
last  adaptation  can  cause  the  weight  rector  to  converge  in  the  mean  to  something  different  than  the  Wiener  solution 
/’radical  experience  has  shown,  however,  that  this  effect  is  generally  insignificant 
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Since  Xmax  must  be  less  than  the  trace  of  JR.  which  is  equal  to  the  total  power  of'  the  input 
signal  components,  the  algorithm  is  unconditionally  stable  when 


>p  >0. 


where  F. 


is  the  power  of  the  ith  signal  component. 


(17) 


Figure  2 shows  a typical  individual  “learning”  curve  a plot  of  mean  square  error  as 
a function  of  time- representing  the  dynamic  behavior  of  the  LMS  algorithm  during  con- 
vergence. Also  shown  is  an  ensemble  average  of  48  learning  curves.  The  ensemble  average 
reveals  the  underlying  exponential  nature  of  the  individual  curve,  which  is  a sum  of  exponen- 
tials. each  associated  with  a natural  mode.  The  number  of  natural  modes  is  equal  to  the 
number  of  degrees  of  freedom  (number  of  weights).  The  time  constant  of  the  pth  mode  is 
related  to  the  pth  eigenvalue  Xp  of  the  input  correlation  matrix  JR  and  to  the  parameter /a  by 

tp  =tV  (18) 

1 mse  4/aXp 


Figure  2.  Typical  learning  curves  for  LMS  algorithm. 
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In  the  special  case  when  all  eigenvalue'  art  it.  1K0  equal  l aider 

these  circumstances,  which  occur  when  .ill  mpM  0 r m 1 mi.  urrcl.itcJ  and  ol 

equal  power,  the  learning  curve  is  a pure  exponential  .ilm-  him  mi  l.inf*  is  given  In 


Tmse  " 4„A  ' 


I Id) 


The  minimum  mean  square  error  is  ideally  realized  when  the  weight  vector  of  the 
adaptive  linear  combiner  equals  the  Wiener  weight  vector  W*.  An  adaptive  algorithm 
operating  in  real  time  with  finite  speed  oh  adaptation,  however,  will  in  most  instances  not 
perfectly  converge  to  W*  because  random  fluctuations  due  to  gradient  estimation  error 
occur  in  the  weight  values  even  at  equilibrium.  The  result  is  a mean  square  error  that  is 

greater  than  ( I e.“  ] . The  amount  by  which  the  actual  error  is  greater  is  called  the 

\ L •'  J ymin 

“excess  mean  square  error.-  The  normalized  excess  mean  square  error  is  in  turn  defined  as 
the  misadjustment  M,  a dimensionless  measure  of  the  difference  between  actual  and  Wiener 
optimal  performance: 


M A average  excess  mean  square  error  , 

■ m~„ 

A good  approximate  formula  for  the  misadjustment  of  the  LMS  algorithm  in  terms  of  the 
number  of  weights  and  the  time  constant  of  the  adaptive  process  is  given  by 


. (21) 

“*rmse 

Liquation  ( 21 1 shows  that  the  misadjustment  can  be  made  arbitrarily  small  by  choosing  a 
long  adaptive  time  constant.  Note  that  for  a given  time  constant  misadjustment  increases 
in  proportion  to  the  number  of  weights. 5 


This  analysis  assumes  that  the  input  signal  statistics  are  stationary.  If  they  are 
slowly  varying  the  LMS  algorithm  can  he  thought  of  as  tracking  the  variation  with  a delay. 
Additional  mean  square  error  and  additional  misadjustment  will  thus  occur.  It  has  been 
demonstrated  that  under  certain  conditions  the  adaptive  time  constant  is  optimal  when  the 
power  of  the  gradient  estimation  noise  is  of  the  same  order  of  magnitude  as  the  excess  mean 
square  error  due  to  the  delay  (ref.  14). 


The  LMS  algorithm  is  based  on  a gradient  estimate  obtained  from  a single  sample  of 
input  data.  It  has  been  found  that  its  rate  of  adaptation  is  nearly  optimal  when  the  eigen- 
values of  R are  equal  (ref.  14).  If  they  are  disparate,  however,  algorithms  based  on  other 
gradient  estimation  techniques,  such  as  Newton’s  method,  offer  potentially  faster  conver- 
gence to  a given  level  of  misadjustment.  Several  algorithms  of  this  type  have  recently  been 
described  (ref.  16,  17). 

If  the  input  signal  vector  is  derived  from  0 tapped  delay  line,  as  in  an  adaptive  transversal  f ilter  (see  below),  the  time 

■} 

cons  taut  can  be  expressed  rfme  Itfuh/x"/,  where  x is  the  input  signal  to  the  tapped  delay  line.  Another  case  of 
interest  in  curs  when  all  but  two  eigenvalues  are  zero,  for  example,  when  the  only  signal  component  is  a sinusoid.  In 
this  case  the  lime  constant  is  given  by  TmS(,  ll4p(nl2)K  / v“/ 

^ The  topics  of  time  constant  and  misadjustment  arc  more  fully  treated  in  references  It.  V.  N.  and  15 


H 


The  LMS  algorithm  also  requires  that  a weight  correction  he  calculated  and  applied 
once  each  input  sample.  Such  a requirement  can  he  inconvenient  in  high-frequency  applica- 
tions where  analog  techniques  are  used.  Further,  in  some  implementations,  the  X-vector  is 
not  available  to  the  adaptive  process.  Algorithms  based  on  direct  gradient  estimation  or 
random  search  techniques  are  preferable  under  these  circumstances.  Unfortunately,  how- 
ever. the  inisadjustment  of  these  algorithms  is  proportional  to  the  square  of  the  number  of 
weights  and  thus  for  a given  rate  of  adaptation  much  higher  than  that  of  the  LMS  algorithm 
(ref.  15). 


THE  ADAPTIVE  FILTER 

A choice  ol  Xy  for  the  adaptive  linear  combiner  produces  an  adaptive  filter.  The 
most  common  choice  is  to  make  x-  samples  of  the  same  signal  at  different  delays,  and  the 

most  common  method  ot  ellecting  this  choice  is  to  connect  the  combiner  to  a tapped  delay 
line  to  form  an  adaptive  transversal  or  finite  impulse  response  (MR)  filter.  This  filter  is 
described  in  lurther  detail  in  the  following  paragraphs,  and  examples  of  its  application  are 
the  subject  of  the  remaining  sections  of  this  report. 

A block  diagram  of  the  adaptive  transversal  filter  is  shown  in  figure  5.  Because  of 
the  structure  of  the  delay  line  the  input  signal  vector  is 

Sj=[xj'xj-1 xj-n+ 1]  T (22) 

The  components  ot  this  vector  are  delayed  versions  of  the  input  signal 

It  is  readily  observed  that  the  impulse  response  of  the  filter  of  figure  3 is  equivalent 
to  the  components  ol  its  weight  vector.  Such  a filter  can  thus  have  any  impulse  response  of 
length  less  than  or  equal  to  its  own  length.  Further,  il  it  is  long  enough,  it  can  approximate 
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any  impulse  response  at  all  and  hence  any  frequency  response.  The  penalty  for  greater 
length,  in  addition  to  greater  complexity,  is  a longer  adaptive  time  constant  or  greater  mis- 
adjustment.  For  many  nonstationary  applications  an  optimal  length  can  he  found. 

A simplified  representation  of  the  adaptive  transversal  filter  is  shown  in  figure  4. 

I his  representation  is  useful  in  depicting  adaptive  systems  that  incorporate  the  filter. 

An  adaptive  system  comprising  several  adaptive  transversal  filters  is  shown  in  figure 
.Y  A system  ol  this  kind  is  useful  in  processing  input  signals  originating  from  different 
sources.  It  is  analytically  equivalent  to  an  adaptive  linear  combiner  with  multiple  inputs 
instead  of  a single  input,  and  its  properties  are  fully  described  by  the  expressions  given  in 
the  preceding  sections  of  this  report. 

Other  methods  of  forming  adaptive  filters,  besides  the  use  of  a tapped  delay  line  to 
Provide  the  X-vector,  include  the  use  of  serial  resistance-capacitance  filters  of  the  same  time 
constant  (dispersive  resistance-capacitance  delay  line)  and  parallel-driven  filters  of  different 
transfer  function  ( ref.  1 8).  In  addition,  it  is  possible  to  derive  the  components  of  the  X- 
vector  from  various  physical  locations.  An  example  is  the  connecting  ol  an  adaptive  linear 


ADAPTIVE 

FILTER 
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Figured.  Simplified  representation 
of  adaptive  transversal  filter. 


10 


combiner  to  the  elements  of  an  antenna  array  to  form  an  adaptive  beamformer  (ref.  10.  II). 
Such  a beam  former  acts  as  a spatial  filter  capable  of  reducing  array  sensitivity  to  directional 
interference.  In  this  respect  it  resembles  the  adaptive  sidelobe  canceller  described  in  one  of 
the  following  sections  of  this  report. 


M 


ADAPTIVE  MODELING 

Assume  that  a signal  s(t)  is  applied  to  a physical  system  of  unknown  impulse 
response  hit)  and  that  it  is  possible  to  measure  s(t)  and  the  system  output  s(t)*h(t).  where 
the  asterisk  denotes  convolution.  Such  conditions  occur,  for  example,  when  a known  signal 
is  transmitted  to  a receiver  over  a multipath  propagation  channel.  The  adaptive  transversal 
filter  described  in  the  preceding  sections  of  this  paper  can  be  used  to  model  h(t)  by  the 
method  shown  in  figure  6.  The  signal  s(t)  or  a local  replica  of  it  is  sampled  to  form  the 
input  \j  of  the  adaptive  filter,  and  the  signal  s(t)*h(t)  is  sampled  to  form  the  desired  response 

dj.  The  filter  output  yj  is  subtracted  from  dj  to  form  the  error  ey  The  adaptive  process 
minimizes  the  difference  between  y j and  dj  to  produce  the  model  of  hit).  The  presence  of 

additive  independent  noise  nit)  in  s(t)*h(t)  contributes  to  noise  in  the  weight  vector  but 
does  not  prevent  convergence  in  the  mean. 

The  results  of  a simple  modeling  problem  simulated  on  the  computer  are  presented 
in  figure  7.  In  this  problem  an  adaptive  transversal  filter  incorporating  a delay  line  with  four 
weighted  taps  was  used  to  model  a fixed  filter  with  a transfer  function  Hi/),  where  / is  the 
unit  delay  operator,  whose  roots  comprised  four  zeros.  The  input  signal  s consisted  of 
Gaussian  noise  with  a "white”  spectrum.  Figure  7(a)  shows  the  location  in  the  z plane  of 
the  zeros  of  the  fixed  filter  and  the  “instantaneous"  adaptive  zeros  in  the  absence  of  addi- 
tive noise.6  Note  that  the  adaptive  model  is  exact.  Figure  7(b)  shows  the  location  of  the 

h hi  this  and  the  succeeding  experiment  the  zeros  and  poles  o)  a time  variable  filter  are  defined  in  a sense  that  does  not 
have  a strict  physical  interpretation,  the  filter  parameters  are  frozen  "at  any  desired  point  in  time  and  the  zeros  and 
poles  found  in  the  same  wav  as  for  a fixed  linear  filter 


nit) 


Figure  (>.  Modeling  an  unknown  dynamic  system  with  an 
adaptive  transversal  filter. 


I I 


(a) 


(b) 

Figure  7.  Results  ot  experiment  in  which  a 
4-zero  fixed  filter  was  modeled  by  a 4-weight 
adaptive  filter,  (a)  Location  of  zeros  after 
convergence  without  noise  in  fixed  filter 
output,  (b)  Location  of  zeros  after  conver- 
gence with  additive  independent  noise  in 
fixed  filter  output. 

zeros  when  additive  independent  noise  was  combined  with  the  fixed  filter  output  in  the 
manner  indicated  in  figure  6.  The  signal-to-noise  ratio  was  0 dB.  In  this  case  the  zeros  of 
the  adaptive  model  vary  their  location  with  time  even  after  convergence  of  the  adaptive 
process  and  are  scattered  about  the  location  of  the  fixed  zeros.  The  mean  location  of  each 
group  of  adaptive  zeros,  however,  is  nearly  the  same  as  the  location  of  the  corresponding 
fixed  zeros.  The  scattering  of  the  adaptive  zeros  in  this  example  illustrates  the  cause  of  mis- 
adjustment,  noise  in  the  weight  vector. 
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For  an  adaptive  transversal  filter  to  converge  to  an  exact  model  of  an  unknown  sys- 
tem the  impulse  response  httl  ot  the  system  must  he  finite,  and  the  filter’s  delay  line  must 
have  a sufficient  number  of  weighted  taps  to  span  lit  t ).  If  h(t)  is  not  finite  an  approximate 
model  can  be  achieved,  though  this  may  require  a large  adaptive  system. 

The  result  of  a computer  simulation  in  which  a 16-weight  adaptive  transversal  filter 
was  used  to  model  a two-pole  fixed  filter  with  an  infinite  impulse  response  is  shown  in  fig- 
ure X.  I he  zeros  ol  the  adaptive  model  are  located  on  a circle  at  a radius  equal  to  that  of 
the  poles  ol  the  fixed  filter  except  at  frequency  co  = 0.  Note  that  the  spacing  is  uniform  but 
that  there  are  no  zeros  at  the  location  of  the  poles.  This  solution  represents  the  best  approx- 
imation (in  the  mean  square  sense)  of  an  all-pole  filter  by  an  all-zero  adaptive  filter. 

An  adaptive  method  of  uniquely  determining  both  the  poles  and  zeros  of  an  unknown 
system  is  described  in  reference  ll>.  The  method  shown  above  could  also  uniquely  determine 
the  poles  and  zeros  of  an  unknown  system  if  recursive  filter  coefficients  could  be  directly 
adapted.  This  type  of  adaptation  is  a current  research  topic.  Further  treatment  of  the 
techniques  and  applications  of  adaptive  modeling  is  provided  in  references  20  through  26. 


Figure  8.  Result  of  experiment  in  which  a 2-pole  fixed  filler  was 
modeled  by  a 16-weight  adaptive  filter. 


ADAPTIVE  EQUALIZATION 

A frequent  problem  in  communication  and  data  transfer  is  intersymbol  interference 
caused  by  multipath  propagation.  This  problem  can  be  solved  by  a filter  placed  in  series 
with  the  propagation  channel  that  produces  the  inverse  of  the  channel  impulse  response. 
Though  such  a filter  normally  cannot  be  designed  without  prior  knowledge  of  the  channel, 
an  approximation  can  be  implemented  by  adaptive  means. 
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A technique  of  adaptive  channel  equalization  is  illustrated  in  figure  d.  A signal  sttl 
is  transmitted  together  with  a known  pilot  signal  pit)  over  a channel  with  an  unknown 
impulse  response.7  In  many  cases  additive  independent  noise  nCt)  is  present.  The  channel 
output  is  sampled  to  form  the  input  \j  to  an  adaptive  filter  connected  in  series  with  the 

channel.  The  desired  response  dj  is  formed  by  sampling  a local  replica  of  the  pilot  signal  pit) 
The  adaptive  process  minimizes  the  difference  between  the  adaptive  filter  output  y(  and  the 
desired  response  d;.  If  a broadband  signal  is  chosen  for  pit),  a truncated  but  stable  approxi- 
mation of  the  optimal  equalization  filter  will  be  realized. 

The  results  of  a digitally  simulated  channel  equalization  problem  are  presented  in 
figure  10.  Figure  10(a)  shows  8 points  of  a typical  channel  impulse  response  hit).  Figures 
10(b)  through  10(d)  show  the  equalized  channel  output  yj.  a convolution  of  channel  and 

equalizer  impulse  responses,  for  adaptive  filters  with  8.  16,  and  32  weights  respectively. 

Note  that  even  for  a filter  with  8 weights  the  worst  sidelobe  of  the  equalized  response  is 
10  dB  down.  In  this  experiment  Gaussian  noise  with  a white  spectrum  was  used  as  the  pilot 
signal,  and  the  desired  response  was  delayed  by  half  the  delay  of  the  adaptive  filter.  In  a 
practical  system  the  pilot  signal  would  be  a long,  repeated  pseudorandom  noise  sequence. 

The  delay  in  the  desired  response  was  necessary  to  achieve  a two-sided  impulse  response  with 
an  adaptive  filter  whose  impulse  response  is  causal  and  finite. 

Communication  channel  equalization  has  become  one  of  the  most  important  and 
widely  known  applications  of  adaptive  filtering  techniques.  The  approach  presented  here, 
entailing  a known  desired  response,  differs  from  the  more  common  approach  based  on 
“decision-directed  learning”  (ref.  27-31). 

'The  pilot  signal  may  also  he  transmitted  as  a preamble;  in  this  ease  the  / liter  weights  are  fixed  during  message 
transmission 
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Figure  10.  Results  of  adaptive  channel  equalization  experiment. 

(a)  Channel  impulse  response,  (b)  After  equalization  with  8-weight 
adaptive  filler,  (c)  After  equalization  with  16-weight  adaptive 
filter,  (d)  After  equalization  with  32-weight  adaptive  filter. 

ADAPTIVE  NOISE  CANCELLING 

Assume  a primary  sensor  receiving  a signal  contaminated  by  noise.  Imagine  that  a 
reference  sensor  can  be  located  to  receive  the  noise  alone.  Then  it  may  be  possible  to  filter 
the  output  of  the  reference  sensor  and  subtract  it  from  the  output  of  the  primary  sensor  to 
obtain  signal  alone.  The  difficulty  is  that  the  propagation  paths  from  the  noise  source  to  the 
two  sensors  must  be  known  to  design  the  appropriate  filter.  These  paths  are  rarely  known 
a priori  and  are  often  slowly  varying. 

The  idea  of  adaptive  noise  cancelling,  as  illustrated  in  figure  I 1.  is  to  find  by  adaptive 
means  a filter  capable  of  transforming  noise  at  a reference  sensor  into  noise  at  a primary 
sensor.  In  the  system  shown  the  combined  signal  and  noise  s + ny  at  the  primary  sensor 

form  the  desired  response  d of  the  adaptive  process,  while  the  related  noise  n | at  the  refer- 
ence sensor  forms  the  input  x to  the  adaptive  filter.  The  output  y of  the  adaptive  filter  is 
subtracted  from  d to  form  the  error  signal  e.  This  signal  is  also  taken  as  the  output  of  the 
canceller.^ 

It  might  seem  that  some  prior  knowledge  of  the  signal  s or  of  the  noises  ny  and  nj 

would  be  necessary  before  the  filter  could  be  designed,  or  before  it  could  adapt,  to  produce 
the  noise  cancelling  signal  y.  A simple  argument  will  show,  however,  that  little  or  no  prior 
knowledge  of  s,  ny.  or  n | . or  of  their  relationships,  either  statistical  or  deterministic,  is 

required. 


*A 


detailed  analysis  of  the  adaptive  noise  canceller  is  provided  in  rejerence 


32. 
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INPUT  L 

ADAPTIVE  NOISE  CANCELLER 


Figure  1 1 . Adaptive  noise  canceller  will)  inpuls. 


Assume  that  s.  mq.  nj , and  y are  statistically  stationary  and  have  zero  means.  As- 
sume that  s is  uncorrelated  with  hq  and  nj.  and  suppose  that  iij  is  correlated  with  iiy.  The 
output  is 

6 = s + n0-y-  (23) 

Squaring,  one  obtains 

e- = s“  + (iiq  - y)“  + 2s  • (iiq  - y).  (24) 

Taking  expectations  of  both  sides  of  equation  ( 24).  and  noting  that  s is  independent  of  iiq 
and  y.  yields 

E|e-|  = E|s“]  + E[(n0  - y)~)  + 2E[s-(n0  - y )] 

= E[s2|  + El(n0 - y)“l.  (25) 

The  signal  power  E[s“)  will  be  unaffected  as  the  filter  is  adjusted  to  minimize  E|e~| . Ac- 
cordingly. the  minimum  output  power  is 

min  E|e“l  = E[s-]  !F  min  E|(n0  - y)"l . (26) 

When  the  filter  is  adjusted  so  that  E [ e “ 1 is  minimized,  E((nQ  - y )~|  is  therefore  also  mini- 
mized. The  filter  output  y is  then  a best  least-squares  estimate  of  the  primary  noise  nQ.  Further, 
when  E[ing-y)“)  is  minimized,  E[(e  -s)“)  is  also  minimized,  since  from  equation  (23) 

(e  - s)  = (nQ  - y).  (27) 

Adjusting  or  adapting  the  filter  to  minimize  the  total  output  power  is  thus  equivalent  to 
causing  the  output  to  be  a best  least-squares  estimate  of  the  signal  s for  the  given  structure 
of  the  adaptive  filter  and  for  the  given  reference  input. 
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To  illustrate  the  application  of  adaptive  noise  cancelling  two  previously  described 
examples  from  the  field  of  electrocardiography  have  been  chosen  (ref.  32).  In  the  first  noise 
cancelling  is  used  to  reduce  power-line  interference  obscuring  the  details  of  a normal  adult 
electrocardiogram  ( ECCi ).  In  the  second  it  is  used  to  cancel  the  dominant  maternal  heart- 
beat as  well  as  power-line  interference  in  order  to  record  a fetal  ECC». 

Power-line  interference  in  electrocardiography  has  various  causes,  including  magnetic 
induction,  displacement  currents  in  leads  or  in  the  body  of  the  patient,  and  equipment  inter- 
connections and  imperfections.  Conventional  methods  of  reducing  such  interference  include 
the  use  of  proper  grounding  and  twisted  pairs  during  the  recording  process.  An  alternative 
method  is  to  use  an  adaptive  noise  canceller  to  process  the  ECCi  recorder  signal. 

f igure  I 2 shows  the  application  of  adaptive  noise  cancelling  to  reduce  power-line 
interference  in  electrocardiography.  The  primary  input  is  taken  from  the  ECO  preamplifier, 
and  the  reference  input  is  taken  from  a wall  outlet.  The  adaptive  filter  contains  two  variable 
weights,  one  applied  to  the  reference  input  directly  and  the  other  to  a version  of  it  shifted  in 
phase  by  ‘>0  degrees.  Die  two  variable  weights,  or  two  “degrees  of  freedom."  are  required 
to  cancel  the  single  pure  sinusoid. 

A typical  result  of  a group  of  experiments  performed  with  a real-time  computer  sys- 
tem is  shown  in  figure  1 3.  figure  1 3(a)  shows  the  primary  input,  an  electrocardiographic 
waveform  with  an  excessive  amount  of  power-line  interference,  and  figure  13(b)  shows  the 
reference  input  from  a 60-Hz  wall  outlet.  Figure  13(c)  is  the  noise  canceller  output.  Note 
the  absence  of  interference  and  the  clarity  of  detail  once  the  adaptive  process  has  converged. 
In  this  experiment  sample  size  was  10  bits  and  sampling  rate  1000  Hz. 


PRIMARY  ECG  RECORDER 


I I 


ADAPTIVE  NOISE  CANCELLER 
Figure  I 2.  Cancelling  power-line  interference  in  electrocardiography. 
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(b) 


Figure  13.  Result  of  electrocardiographic  noise  cancelling 
experiment,  (a)  Primary  input,  (b)  Reference  input. 

(c)  Noise  canceller  output. 


Abdominal  electrocardiograms  make  it  possible  to  determine  fetal  heart  rate  and  to 
detect  multiple  fetuses  and  are  often  used  during  labor  and  delivery.  Background  noise  due 
to  muscle  activity  and  fetal  motion,  however,  often  has  an  amplitude  equal  to  or  greater 
than  that  of  the  fetal  heartbeat.  A still  more  serious  problem  is  the  mother’s  heartbeat, 
which  has  an  amplitude  two  to  ten  times  greater  than  that  of  the  fetal  heartbeat  and  often 
interferes  with  its  recording. 

A group  of  experiments  was  performed  to  demonstrate  the  application  of  adaptive 
noise  cancelling  in  reducing  the  maternal  interference  in  fetal  electrocardiography.  In  these 
experiments  four  chest  leads  were  used  to  record  the  maternal  heartbeat  and  provide  multi- 
ple reference  inputs  containing  all  significant  components  of  the  interference.  A single 
abdominal  lead  was  used  to  record  the  combined  maternal  and  fetal  heartbeats  and  provide 
the  primary  input.  Each  lead  terminated  in  a pair  of  electrodes.  The  reference  and  primary 
inputs  were  prefiltered,  digitized,  and  recorded  on  tape.  They  were  then  processed  in  a 
multichannel  adaptive  noise  canceller,  shown  in  figure  14,  which  incorporated  a four-channel 
adaptive  filter  similar  to  the  multiple-input  filter  shown  above  in  figure  5.  Each  filter 
channel  had  32  taps  with  nonuniform  spacing  (log  periodic)  and  a total  delay  of  1 29  ms. 

Figure  I 5 shows  the  result  of  a typical  experiment.  The  prefiltering  band  was  0.3  to 
75  Hz  and  the  sampling  rate  51  2 Hz.  Baseline  drift  and  60-Hz  power-line  interference  are 
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clearly  present  in  the  primary  input,  obtained  from  the  abdominal  lead.  The  interference  is 
so  strong  that  it  is  almost  impossible  to  detect  the  fetal  heartbeat.  The  inputs  obtained  from 
the  chest  leads  contained  the  maternal  heartbeat  and  a sufficient  60-Hz  component  to  serve 
as  a reference  for  both  interferences.  In  the  noise  canceller  output  both  interferences  have 
been  significantly  reduced,  and  the  fetal  heartbeat  is  clearly  discernible.  The  noise  still 
evident  on  the  waveform  is  that  due  to  muscle  activity. 
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f igure  14.  Multiple-reference  noise  canceller  used  in  fetal  ECG  experiment. 
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Figure  I 5.  Result  of  fetal  ECG  experiment,  (a)  Reference  input  (chest 
lead),  (b)  Primary  input  (abdominal  lead),  (c)  Noise  canceller  output. 
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I. 


ADAPTIVE  SIDLLOBE  C ANCELLING 


Adaptive  noise  cancelling  can  be  applied  to  the  output  of  a receiving  antenna  array 
to  increase  gain  substantially  against  nonisotropic  noise,  in  particular  against  noise  originating 
from  point  sources.  No  prior  knowledge  of  the  received  signal  except  for  its  direction  of 
incidence  is  required.  Sufficient  knowledge  of  the  antenna  array  must  he  available  to  allow 
the  formation  of  crude  beams. 

An  idealized  adaptive  sidelobe  canceller  is  shown  in  figure  16.  This  system  includes 
two  beamformers.  one  of  which  steers  a beam  and  the  other  a null  in  the  direction  of  the  sig- 
nal. I he  output  of  the  main  beamformer  is  the  primary  input  to  the  canceller,  while  the 
output  of  the  null  beamformer  is  the  reference  mput. 

Assume  a signal  s incident  in  the  steering  direction  of  the  main  beam  of  the  system 
ot  figure  I 6 and  a statistically  independent  noise  nQ  incident  on  a sidelobe  of  the  main  beam. 

The  output  of  the  null  beamformer,  assuming  a perfect  null  in  the  steering  direction  of  the 
main  beamtormer,  will  contain  a response  to  the  noise  iiq  only.  The  null  beamformer  output 

is  adaptively  filtered  and  subtracted  from  the  main  beamformer  output  to  produce  a system 
output  free  of  noise. 

In  a practical  sidelobe  cancelling  system  a perfect  null  is  not  achievable  because  the 
properties  ot  the  antenna  array  elements  are  not  ideal.  For  a multiweight  adaptive  filter  and 
in  the  absence  ot  isotropic  noise,  the  output  signal-to-noise  spectral  density  ratio  of  the  sys- 
tem ot  figure  1 6 is  given  by 


(pyp"  out  = ^iir'^sr’ 


where  pSr  and  p)1r  are  respectively  the  signal  and  noise  power  spectral  density  at  the  null 

beamformer  output  (ref.  32).9  If  the  ratio  of  the  null  beamformer's  power  gain  in  the  stee 
mg  direction  of  the  main  beamformer  to  its  power  gain  in  the  direction  ot  incidence  of  the 
noise  Uq  is  defined  as  a,  equation  (28)  becomes 


where  <PS/Pn  >in  is  the  free-field  input  signal-to-noise  spectral  density  ratio.  Thus,  if  the  free- 

field  input  signal-to-noise  spectral  density  ratio  is  sufficiently  low,  a null  beamformer  is  not 
required,  and  the  reference  input  can  be  derived  from  an  omnidirectional  sensor  to  = I ). 

To  illustrate  the  level  of  interference  rejection  achievable  with  adaptive  sidelobe  can- 
celling a typical  problem  was  simulated  on  the  computer  (ref.  321.  A circular  array  consist- 
ing of  1 6 equally  spaced  omnidirectional  elements  was  chosen.  The  outputs  of  the  elements 
were  delayed  and  summed  to  form  a main  beam  steered  at  a relative  angle  of  0 degrees.  A 
simulated  signal  consisting  ot  uncorrelated  samples  of  noise  of  unit  power  was  assumed  to  he 
incident  on  this  beam.  Simulated  interference  with  the  same  bandwidth  and  a power  of  100 

vl  <>r  a small  number  of  weights  inversion  of  signal  to  rtoise  rather  than  spectra!  density  ratio  occurs 
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f igure  16.  Adaplive  sidclohe  canceller,  (a)  Block  diagram,  (b)  Typical  beam 
patterns  with  input  signals. 


was  incident  at  a relative  angle  ot'  58  degrees.  The  array  was  connected  to  an  adaptive  noise 
canceller  in  the  manner  shown  in  figure  1 6,  except  that  there  was  no  null  beamformer  and 
the  output  of  element  4 was  arbitrarily  chosen  as  the  reference  input.  The  canceller  included 
an  adaptive  filter  with  14  weights;  the  adaptive  constant  of  the  LMS  algorithm  was  set  at 

H = 7 X 1 O'6. 

Figure  1 7 shows  two  series  of  computed  directivity  patterns,  one  representing  single 
frequency  of  one-fourth  the  sampling  frequency  and  the  other  an  average  of  eight  frequencies 
of  from  one-eighth  to  three-eighths  the  sampling  frequency.  These  patterns  indicate  the 
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Figure  17  Results  of  adaptive  sidelobe  cancelling  experiment,  (a)  Single 
frequency  (one-fourth  of  sampling  frequency)  (b)  Average  of  eight  fre- 
quencies (one-eighth  to  three-eighths  of  sampling  frequency). 
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evolution  of  the  main  beam  and  sidelobes  as  observed  by  stopping  the  adaptive  process  after 
the  specified  number  of  iterations.  At  the  start  of  adaptation  all  weights  were  set  at  zero, 
ptoviding  a conventional  16-element  beam  pattern.  After  adaptation  deep  nulls  have  formed 
in  the  direction  of  the  interference.  Note  that  a small  amount  of  signal  cancellation  occurred, 
as  evidenced  by  the  change  in  sensitivity  ot  the  main  beam  in  the  steering  direction.  This 
change  was  not  unexpected,  since  the  main  beam  pattern  was  not  constrained  by  the  adaptive 
process.  The  signal-to-noise  ratio  at  the  system  output,  averaged  over  the  eight  frequencies, 
was  found  after  convergence  to  be  20  dB.  The  signal-to-noise  ratio  at  the  single  array  element 
was  -20  dB.  1 his  result  is  in  accordance  with  the  expectation  arising  from  equations  (28) 
and  (2b),  which  express  output  signal-to-noise  ratio  as  the  reciprocal  of  input  signal-to-noise 
ratio. 


In  the  absence  of  noise  or  with  a narrowband  input  signal  equations  (28)  and  (26) 
predict  poor  performance.  A number  of  methods  of  combating  this  result,  as  well  as  the  sig- 
nal cancellation  observed  in  the  foregoing  experiment,  have  been  described  in  the  literature 
(ref.  33-36).  In  one  of  these  methods,  illustrated  in  figure  18,  the  null  beamformer  and 
single-input  adaptive  filter  used  to  form  and  process  the  reference  input  in  the  system  of 
figure  1 6 are  replaced  by  a multichannel  adaptive  filter  similar  to  the  one  shown  above  in 
figure  5.  The  response  of  this  filter,  which  acts  as  an  adaptive  null  beamformer,  is  constrained 
to  be  zero  in  the  steering  direction  of  the  conventional  beamformer  by  requiring  the  sum  of 
each  column  of  filter  weights  to  be  zero. 

3 T = [0.  0 0|.  (30) 

where  3 is  defined  as  the  vector  of  column  constraints.*® 

I I'll  is  constraint,  suggested  by  /.  ./.  Griffiths  (ref  J6,  private  communication) . is  equivalent  to  the  constraint  inherent  in 
O l Frost  s algorithm  (ref.  34).  Vote  that  for  steering  directions  other  than  normal  to  the  array  the  adaptive  filter 
inputs  are  derived  from  the  conventional  beam  former's  delays  rather  than  directly  from  the  elements.  Vote  also  that 
the  conventional  beamformer  s output  is  delayed  by  an  amount  equal  to  one  half  the  total  delay  A of  the  tapped  delay 
line  of  the  adaptive  filters  or  A /2.  this  delay  provides  the  adaptive  system  with  a limited  predictive  capability. 


ADAPTIVE  NOISE  CANCELLER 


Figure  18.  Constrained  adaptive  sidelohe  canceller. 
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The  method  of  column  constraints  guarantees  a system  response  in  the  steering 
direction  of  the  main  beam  equal  to  the  response  of  the  conventional  beamformer,  provided 
that  array  properties  are  ideal.  With  an  actual  array,  however,  a loss  of  performance  with 
respect  to  that  of  the  conventional  beamformer  is  experienced  because  of  array  gain  and 
phase  errors  due  to  irregularities  in  element  placement,  transfer  function,  and  near-field 
effects.  This  loss  is  an  example  of  the  well-known  sensitivity  of  constrained  algorithms  to 
array  tolerances  (ref.  37). 


An  alternative  method  of  constrained  adaptive  sidelobe  cancelling  has  recently  been 
proposed  that  is  relatively  insensitive  to  array  gain  and  phase  errors  (ref.  I 5,  38 1.  This 
method  provides  a means  of  rejecting  large  signals  incident  on  the  sidelobes  of  an  array  while 
preserving  small  narrowband  and  large  as  well  as  small  broadband  signals  incident  in  the 
steering  direction.  In  exchange  for  error  tolerance  broadband  superdirectivity  and  large- 
narrowband  signal  reception  are  lost. 


The  alternative  method  is  identical  to  the  method  already  described  except  in  its 
form  of  constraint.  Instead  of  the  sum  of  each  column  of  adaptive  filter  weights  the  column 
of  individual  weights  at  the  middle  of  each  filter  and  an  additional  column  to  either  side  ol 
it  are  constrained  to  be  zens.  The  middle  column  of  zero  weights  prevents  errors  in  gain 
from  affecting  the  canceller’s  performance.  The  additional  column  to  either  side  prevents 
errors  in  phase  from  affecting  performance. 


Operation  of  the  adaptive  sidelobe  canceller  with  this  method  of  constraint  and 
broadband  signals*  1 can  be  understood  by  considering  equations  (3).  (6),  and  ( 10),  which 
describe  the  error  e.  the  cross  correlation  P between  the  desired  response  d and  the  input 
signal  vector  X,  and  the  optimal  weight  vector  W*.  If  a signal  with  a white  spectrum  is  inci- 
dent on  the  array,  no  correlation  will  exist  between  any  component  of  the  input  signal  vector 
and  the  desired  response  until  the  angle  of  incidence  is  such  that  6 J5  where  6 is  the  signal 
delay  across  the  array's  aperture  and  6'  is  the  delay  across  the  zero-constrained  weights  of 
the  adaptive  filter.  In  the  region  0 < 6 < 6\  therefore,  no  component  of  P will  be  other  than 
zero,  and  hence  P and  the  optimal  weight  vector  W*  will  be  zero.  Under  these  circumstances 
the  error  (or  system  output)  is  equivalent  to  the  desired  response.  When  6 > 6'.  P becomes 
other  than  zero  and  the  possibility  of  rejection  exists.  The  effect  of  array  gain  or  phase 
errors  is  to  alter  the  relationship  between  source  angle  and  delay  5'. 

The  performance  of  the  error-tolerant  sidelobe  canceller  can  be  illustrated  by  a typi- 
cal problem  simulated  on  the  computer.  In  this  problem  it  is  assumed  that  a directional 
broadband  signal  with  a white  spectrum  is  incident  on  the  array  elements  successively  over 
a I 80-deg  sector.*  - There  is  a background  of  uniform  nondirectional  broadband  noise  with 
a white  spectrum.  Signal-to-noise  ratio  is  20  dB.  The  receiving  array  is  assumed  to  comprise 
ten  elements  in  a line  configuration;  element  spacing  is  one-half  wavelength  at  the  sampling 
frequency.  The  conventional  beamformer  is  assumed  to  be  steered  in  the  direction  normal 
to  the  array. 

To  illustrate  the  advantage  of  the  error-tolerant  canceller,  results  are  presented  for 
ideal  and  nonideal  forms  of  the  array  described  above  and  for  two  forms  of  zero  constraint 
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Operation  with  narrowband  signals  is  treated  in  reference  3X 
* 'Note  that  the  directional  signal  is  directional  interference  when  not  incident  on  the  main  lohe  o)  tin  conventional 
beamformer 
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on  the  adaptive  filter  weights.  The  two  forms  of  the  array  are  shown  in  figure  19;  in  the 
ideal  form  the  elements  are  assumed  to  he  in  perfect  alignment,  while  in  the  nonideal  form 
the  single  elements  at  each  end  are  assumed  to  he  set  forward  one-quarter  of  a wavelength. 

I he  two  forms  of  constraint,  shown  in  figure  20.  where  the  rows  and  columns  represent 
respectively  the  tillers  and  tiller  weights  and  where  w and  0 represent  respectively  the  weights 
controlled  and  not  controlled  by  the  adaptive  process,  may  he  described  as  a “single  column 
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f igure  in.  Forms  of  array  used  in  error-tolerant 
sidelobe  cancelling  experiment,  (a)  Ideal  array, 
(b)  Nonideal  array. 
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figure  20.  Weighling  coefficient  matrices  for 
error-tolerant  constrained  adaptive  sidelobe 
canceller,  (a)  Single  column-of-zeros con- 
straint. (b)  Triple  column-of-zeros  constraint, 
(c)  “Hourglass”  constraint. 
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of  zeros”  and  a “triple  column  of  zeros.”  The  first,  which  prevents  errors  in  gain  but  not  in 
phase  from  affecting  performance,  is  that  suitable  for  the  ideal  array.  The  second,  which 
pi  events  errors  in  both  gain  and  phase  from  affecting  performance,  is  that  suitable  for  the 
nonideal  array.  Also  shown  is  a configuration  of  weighting  coefficients  that  would  allow' 
reception  of  strong  broadband  signals  over  a finite  and  controllable  angular  sector;  in  this 
configuration  the  zeros  are  arranged  in  the  form  of  an  “hourglass." 

Figure  21  shows  simulated  directional  response  patterns  indicating  the  performance 
of  the  error-tolerant  adaptive  sidelobe  canceller  with  the  single  anil  triple  column-of-zeros 
constraints.  The  directional  response  of  the  conventional  beamformer  is  also  shown  for  pur- 
poses of  comparison.  Figure  21(a)  represents  the  canceller’s  response  with  the  ideal  array 
and  the  single  column-of-zeros  constraint;  note  that  the  beam  formed  is  “superdirective” 
that  is.  much  narrower  than  the  conventional  beam.  Figure  21(b)  represents  performance 
with  the  nonideal  array  and  single  column-of-zeros  constraint;  the  beam  is  severely  reduced 
in  sensitivity  when  array  properties  are  not  ideal.  Figures  21(c)  and  21(d)  show  the  cancel- 
ler’s performance  with  the  triple  column-of-zeros  constraint.  In  this  case  the  adaptive  beam 
is  closer  in  width  to  the  conventional  beam,  but  its  sensitivity  is  not  significantly  affected  by 
the  misaligned  elements.  The  new  form  of  constraint  thus  represents  a compromise  between 
directivity  and  sensitivity  to  array  imperfection,  preserving  the  fundamental  capability  of  an 
adaptive  beamformer  to  reject  interference  not  incident  in  the  steering  direction. 

ADAPTIVE  PREDICTION.  SIGNAL  SEPARATION. 

AND  SPECTRAL  LINE  ENHANCEMENT 

Prediction  filters  can  be  used  to  provide  estimates  of  statistically  stationary  signals  at 
future  times.  If  the  statistics  of  the  signal  are  known  a priori,  a fixed  prediction  filter  can  be 
designed.  In  the  absence  of  such  knowledge  an  adaptive  predictor  that  uses  measurements 
of  the  signal  statistics  can  be  implemented. 

An  adaptive  predictor  incorporating  an  adaptive  transversal  filter  is  shown  in  figure  22. 
The  desired  response  of  this  system  is  the  unknown  but  stationary  signal  whose  characteristics 
are  to  be  predicted  at  some  future  time  t + 6.  The  input  to  the  adaptive  filter  is  this  signal 
delayed  by  the  time  6.  The  filter  converges  to  a weight  vector  solution  that  best  matches  the 
delayed  to  the  undelayed  signal.  This  solution  is  duplicated  in  a slave  filter,  identical  in 
structure  to  the  adaptive  filter,  which  is  used  to  process  the  undelayed  signal  directly  and  to 
obtain  an  optimal  least-squares  prediction  of  this  signal  at  time  t + 6.* 

The  adaptive  predictor  of  figure  22,  as  shown  in  figure  23,  can  be  used  without  the 
slave  filter  as  a separator  of  broadband  and  narrowband  signals.  Assume  an  input  signal  com- 
posed of  broadband  and  narrowband  components  that  is.  components  of  narrow  and  wide 
autocorrelation  function.  The  delay  6 will  cause  decorrelation  of  the  broadband  components 
appearing  in  the  adaptive  filter  input  from  those  in  the  desired  response.  These  components 
will  thus  appear  in  the  error  but  not  in  the  filter  output.  The  narrowband  components,  on 
the  other  hand,  will  not  be  decorrelated  by  the  delay  and  will  appear  in  the  adaptive  filter 
output. 


More  detailed  treatment  of  the  adaptive  predictor  is  provided  in  references  S.  V.  Id.  and  .?V. 
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Figure  21.  Results  ot  error-tolerant  adaptive  sidelobe  cancelling  experiment, 
(al  Single  column-of-zeros  constraint,  ideal  array.  ( b ) Single  column-of-zcros 
constraint,  nonideal  array,  (c)  Triple  column-of-/eros  constraint,  ideal  array, 
(d)  Triple  column-of-zeros  constraint,  nouideal  array. 


Figure  24  presents  the  results  of  a computer  simulation  demonstrating  the  separation 
ot  broadband  and  periodic  signal  components  (ref.  32).  Figure  24(a)  shows  the  input  signal, 
composed  ot  (.aussian  noise  with  a colored  spectrum  and  a sine  wave.  Figure  24(h)  shows 
the  broadband  output  of  the  separator,  and  figure  24(c)  shows  the  periodic  output  The 
broadband  and  periodic  components  of  the  input  signal  are  also  shown  for  comparison  with 
the  outputs.  Note  the  close  correspondence  in  form  and  registration.  The  correspondence 
is  not  perfect  only  because  the  adaptive  filter  was  of  finite  length  and  had  a finite  rate  of 
adaptation. 

The  adaptive  signal  separator  of  figure  23  can  further  be  used  as  a spectral  line 
enhancer  capable  of  detecting  narrowband  signals  of  very  low  amplitude  masked  by  back- 
ground noise  (ret  32. 40).  In  this  application  an  estimate  of  the  narrowband  components 
ot  the  input  signal  is  made  from  the  transfer  function  of  the  adaptive  filter,  which  is  obtained 
by  taking  the  Fourier  transform  of  the  adaptive  filter’s  weight  vector  W.  14 

f igure  25  presents  experimental  results,  obtained  by  computer  simulation,  that  com- 
pare the  performance  ot  the  adaptive  line  enhancer  with  that  of  conventional  Fourier  analy- 
sis in  detecting  a sine  wave  in  Gaussian  noise  (ref.  40).  The  results  presented  show  the 
magnitude  ot  the  adaptive  filter  transfer  function  and  the  output  power  spectral  density  of 
the  fourier  processor  as  a function  of  normalized  frequency.  The  adaptive  filter  had  1 'X 
weights,  and  the  digital  Fourier  transform  had  I 28  points.  The  sampling  frequency  was  1 

1 be  number  ot  data  samples  used  was  32.768  in  each  case.  The  line  enhancer  delay  was  set 
at  256  samples. 

figure  25(a ) shows  the  performance  of  Fourier  processor  and  line  enhancer  against 
Gaussian  noise  with  a white  spectrum.  Figures  25(b)  and  25(c)  show  performance  against 
(.aussian  noise  whose  spectrum  was  50  percent  white  and  50  percent  colored.  The  colored 
noise  had  a bandwidth  of  25  percent  and  was  generated  by  passing  white  noise  through  a 
i ter  with  two  conjugate  poles.  The  colored  noise  peak  was  at  a frequency  of  0 250  Note 
that  the  narrowband  signal  is  clearly  detected  by  the  line  enhancer  as  well  as  the  Fourier 
processor  even  when  its  frequency  is  almost  the  same  as  that  of  the  colored  noise  peak.  Note 
also  that  the  response  ot  the  line  enhancer  to  the  colored  noise  is  negligible. 

figure  26  presents  the  results  of  a different  but  related  experiment  in  which  the 
adaptive  separator  was  used  to  resolve  signals  of  small  amplitude  in  the  presence  of  a signal 
ot  large  amplitude  (ref.  40).  Figure  26(a)  shows  the  power  density  spectrum  of  the  separator 
input,  which  consists  of  three  sine-wave  signals  whose  relative  powers  are  1 25,  0.1  25,  and 
0.5  and  whose  relative  frequencies  are  respectively  0.1796875,0.15625  and  0 4^  187 5 
1 hese  signals  are  summed  with  white  noise  of  unit  power.  The  sampling  frequency  is  V. 

Note  that  the  first  signal  is  close  in  frequency  to  and  one-thousand  times  more  powerful 
than  the  second  signal,  which  is  buried  in  a sidelobe  of  the  first  signal  and  is  not  resolvable. 

I he  third  signal  also  is  not  resolvable.  Even  when  the  spectrum  of  figure  26(a)  is  taken 
through  a Hanning  window  and  plotted  on  a logarithmic  scale,  the  second  signal  is  undetect- 
able  and  the  third  signal  though  detectable  is  smaller  in  amplitude  than  many  of  the  sidelobes 
ol  the  first  signal.  On  the  other  hand,  as  shown  in  figure  26(b).  when  the  power  density 


,4The  adaptive  separator  has  also  hen,  used  to  implement  the  max, mum  entropy  filter  of  reference  4!  In  this  at*  an 
instantaneous  estimate  of  the  frequency  of  a narrowband  signal  of  high  signal-tonoise  ratio  is  nude  (ref  If,.  42). 
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Figure  24.  Results  of  signal  separation  experiment,  (a)  Input  signal  (colored  Gaussian  noise  and 
sine  wave),  (b)  Error  output  (colored  Gaussian  noise),  (c)  Adaptive  filter  output  (sine  wave). 
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Figure  25.  Results  of  signal  detection  experiment,  (a)  Signal  of  frequency  0.1 25  in  white 
noise,  (b)  Signal  of  frequency  0. 1 25  in  50  percent  white  and  50  percent  colored  noise; 
colored  noise  peak  at  frequency  0.250.  (c)  Signal  of  frequency  0.220  in  50  percent  white 
and  50  percent  colored  noise;  colored  noise  peak  at  frequency  0.250. 
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Figure  26.  Results  of  signal  resolution  experiment. 

(a)  Spectrum  of  separator  input  composed  of  three 
sine-wave  signals  of  relative  power  1 25  at  frequency 
f,  = 0.1  796875.  0.1 25  at  frequency  f,  =0.15625, 

and  0.5  at  frequency  f^  = 0.421875  summed  in 

white  noise  of  unit  power,  (b)  Spectrum  of  error 
output  of  separator. 

spectrum  of  the  error  output  of  the  separator  is  taken,  the  strong  first  signal  is  absent,  can- 
celled by  the  adaptive  process,  and  the  weak  second  and  third  signals  as  well  as  the  broadband 
background  noise  of  the  input  are  clearly  visible. 

The  plots  of  figure  26  are  normalized  so  that  full  scale  corresponds  to  the  largest 
amplitude  point  of  each.  The  spectra  of  the  input  and  error  output  were  taken  by  digital 
Fourier  analysis;  the  Fourier  transform  had  1 28  points,  and  there  was  no  ensemble  averaging. 
The  64-weight  adaptive  filter  cancelled  the  first  signal  within  approximately  five  cycles  of  its 
own  frequency;  that  is,  within  approximately  30  sample  periods.  Although  an  equivalent 
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result  could  have  been  obtained  by  Fourier  analysis  alone,  it  probably  would  have  required 
substantially  more  data. 

Adaptive  techniques,  as  shown  by  the  results  of  these  experiments,  are  competitive 
with  conventional  digital  Fourier  analysis  in  detecting  low-level  sine  waves  in  noise.  Since 
adaptive  techniques  are  different  in  implementation  from  Fourier  analysis,  they  may  be 
more  practicable  in  certain  applications.  In  any  case  they  offer  a promising  new  methodology 
whose  full  capabilities  remain  to  be  defined. 
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